REMOTE DATA PROTOCOL 
BACKGROUND OF THE INVENTION 
Field of the Invention 

5 

The invention relates to a host computer system or server, which has a web 
browser running on it, and the display of the web browser is transmitted via 
modem and received by a cellular phone connected to a PDA device which 
displays the image. In particular, the Remote Data Protocol of the invention 
10 consists of multiple virtual machines which are contained in the server, and each 
contains a browser which has applications running in them. Multiple clients are 
p represented by software, which sends the display of each virtual machine to the 
^ remote PDA device to be displayed, and also relays information back to the 
SJ virtual machine from the PDA device. 

A particular advantage of this method lies in replacing a conventional terminal on 
s a network system with software, which communicates with the PDA device and 

Ljl 

U the server. 

p 20 Description of the Prior Art 

Microsoft Remote Data Protocol uses a main server in which a virtual machine 
runs multiple applications. Each virtual machine is connected to a dedicated 
terminal or client, which displays the image of the virtual machine. The 

25 advantage of this is to avoid a dedicated computer with application programs for 
each client, where multiple clients may access applications on a server. All data 
processing is done in the sever and displayed on terminals, which is a cheaper 
solution for multiple clients using this Remote Data Protocol. The terminals allow 
keyboard and mouse commands to be transferred to the server on a network 

30 system. 
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SUMMARY OF THE INVENTION 

The present invention relates to multiple portable high speed Internet access 
PDA (Personal Digital Assistant) devices that can access the Internet and World 
Wide Web as wireless devices, using a RDP (Remote Data Protocol) client and 
5 sever system to facilitate multiple PDA users simultaneously on a single server. 

A principal embodiment has a Web server connected to the Internet. This server 
contains a virtual browser that takes the image displayed in the browser and 
converts this image into a bit map which is compressed, and communicates via 
telephone lines to a cellular telephone. The cellular telephone is connected to a 
10 high speed internet access device commonly referred to as a PDA (Personal 

O 

iQ Digital Assistant) which is comprised of a display screen, battery and related 
pj micro-electronics. This enables the PDA to receive, decompress and view the bit 
\J map image sent from the virtual browser, and more importantly, through cellular 
ft! phone connectivity to be able to input data or commands from the PDA directly 
Nl 15 onto the server. The host computer or server receives vector information or 

compressed data in the form of HTML, JPEG, etc., which is displayed on a web 
S page. The virtual browser virtually displays a virtual image on the server. That 

W image, in whole or in parts, is recompressed and sent to the PDA. In particular, 

f*"*s 

g the host computer contains an RDP server which has multiple virtual machines 
20 contained within, with each virtual machine containing a web browser. Multiple 
RDP clients interact with the virtual machines with a dedicated virtual machine for 
each client on the server. Each client is represented by software, which sends 
the display of the virtual machine to a single remote PDA device via a dedicated 
modem port. This modem port allows two way communication between a single 
25 PDA and a dedicated virtual machine on the server, via a single RDP client. By 
implementing multiple virtual machines and multiple RDP clients with multiple 
modem ports, it is now possible to communicate with multiple users of PDA 
devices on the RDP server to facilitate Internet browsing, electronic message 
communication, etc. The RDP client relays information received via a modem 
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port from the PDA, such as mouse clicks or keyboard commands, to the 
application program in the virtual machine, which is then processed and a 
refreshed display sent back to the PDA via the same dedicated RDP client and 
modem port. The browser on a virtual machine relays display information to the 

5 dedicated RDP client such as bitmap files, vector files, commands, buffer 
information, etc. The RDP client then rasterizes some of the information by 
drawing it into memory and then proceeds to break up this file into smaller blocks 
of information. These blocks are compressed and sent to the PDA device 
through a dedicated modem port connected to each RDP client. The PDA would 

10 then receive, decompress and assemble the blocks of information in the original 
order as first received by the RDP client before the RDP client breaks up into 
smaller blocks. The browser running in each virtual machine rasterizes most of 
the information which is sent to the RDP client such as text, etc., but the RDP 
client may have to rasterize other information such as blocks, etc. - 




The PDA sends specific data to the virtual machine informing of the 



J* current location of the displayable area of the PDA screen with respect to the 

larger image sent from the browser. This is necessary, as the area displayed by 

P 

□ the PDA is smaller than the displayable image on the browser window. The RDP 
20 client would send compressed blocks of data representing the image to be 

□ displayed in order of priority, such that the first blocks sent to and decompressed 
by the PDA are in the displayable area of the PDA, which is the current area 
where the user is viewing. The PDA would then decompress blocks surrounding 
the displayed area in a particular sequence, such as left to right across rows, and 

25 store the image in internal memory. The PDA assembles blocks of the image in 
a virtual page, which comprises the entire image, thus enabling the user to 
access any part of the present image without communicating constantly with the 
RDP client. Hence, as the user scrolls across the image in any direction, the 
blocks of data comprising the image would already be decompressed and 

30 assembled priority-wise for instant viewing. Blocks of the image in closer 

proximity to the displayed area of the PDA screen get decompressed and stored 
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into internal memory on higher priority than blocks further away. The PDA 
continuously sends its current location to the virtual machine on the server to 
keep getting refreshed data instantaneously as the location changes by the user 
scrolling or sending commands. This enables a rapid refresh rate of the 
5 displayed image especially when scrolling, as areas surrounding the displayed 
image would be decompressed and already stored in memory. 

A mouse click or any keyboard command is given priority in 
communication between the PDA and the RDP server. Such actions from the 
10 PDA are sent instantaneously, interrupting the current activities and this action 
directed to the web browser on the dedicated virtual machine, which sends a 
Q refreshed image back to the PDA device. This feature allows the user to have 
J3 rapid response to commands. If the user initiates a mouse click or keyboard 
S3 command on the PDA that does not change the displayed image on the RDP 
^ 15 server, then the original activities are continued almost instantly with minimum 

U1 interruption. However, if the image is changed and refreshed on the RDP server, 

SJ 

s " any old image being sent is stopped and the new image is sent immediately to 
JZ the PDA if it is a full screen image occupying all or part of the PDA display 
P screen. If the refreshed image sent occupies a part of the PDA display screen 
5 20 and also areas outside the display screen, then the portion of the refreshed 
S image that is displayed on the PDA display screen is sent first to the PDA, and 
blocks of the image are sent to the PDA which are decompressed and stored in 
internal memory, in order of priority closest to the displayed image, as previously 
described. Hence the PDA would assemble blocks of the image in the virtual 
25 page, which comprises the entire image, starting first with the current location of 
the PDA display screen then areas around it. 

A beacon is sent form the PDA device to the RDP client and vice-versa 
many times per minute to confirm that a connection is established and 
30 maintained, for the duration of use. In the instance a user is disconnected, either 
the PDA or the RDP client will not receive a beacon and a time-out will be 




4 




initiated, whereby both the PDA and RDP client disconnect and then reconnect. 
The user would still be able to view the present image and scroll around it as this 
image would already be decompressed in order of priority and stored in internal 
memory. The PDA would indicate in a message area that a reconnect sequence 

5 was initiated, and the status of this connection to the same RDP client as before, 
which would refresh the PDA with the image if it has changed once reconnection 
is established. Similarly, the PDA would continue downloading blocks of 
information after being reconnected if a disconnection interrupted this operation. 
A beacon is not necessarily sent from the RDP client at times when it is sending 

10 information to the PDA. As long as the PDA is receiving information such as a 
refreshed image, or a beacon, it knows a connection is established. 
Consequently, when there is no new activity in the virtual machine, the RDP 
client must send a beacon to the PDA to confirm the connection is established. 
The PDA device must always send beacons to the RDP client, as commands are 

15 not sent frequently from the PDA and only for a short duration when sent. 

An error protocol is implemented to verify that all information blocks are 
received and can be decompressed successfully. As previously described, the 
image displayed in the virtual browser in the virtual machine on the RDP server is 

20 broken down into smaller blocks of information and compressed and transmitted 
to the PDA device. The blocks are then assembled in correct sequence, 
decompressed and stored in internal memory on the PDA. Each block of 
information received is acknowledged by the PDA, which sends a signal 
confirming that each block is successfully received. Hence, the RDP client can 

25 monitor the successful decompression of all blocks of information sent to the 
PDA, and would know when a block is not acknowledged. The RDP client would 
also inform the PDA of the number of transmitted blocks of information, with each 
block identified numerically. The PDA also initiates another error protocol when 
a block of information received can not be successfully decompressed and 

30 stored in memory. In this case, the PDA would send an error message to the 
RDP client informing which block of information needs to be sent again, and the 



5 



RDP client would send this block after it has completed sending the current block 
of information. The RDP client would monitor the acknowledgement of all blocks 
of information successfully decompressed, including blocks sent again after 
receiving error messages from the PDA device. 



BRIEF DESCRIPTION OF THE DRAWINGS 



The invention is described in more detail below with respect to an illustrative 
embodiment shown in the accompanying drawings in which: 

5 Fig. 1 illustrates Prior Art whereby a PDA device is connected to a cellular 
phone, which communicates wirelessly to a Host Computer. 

Fig. 2 illustrates Prior Art of a Remote Data Protocol system. 

10 Fig. 3 illustrates the displayable area of the PDA device with respect to portions 
of the image, which are sequentially decompressed prior to viewing. 

q Fig. 4 illustrates the Remote Data Protocol of the present invention. 

y3 

yi 15 Fig. 5 illustrates a block diagram of the virtual page with respect to the viewing 
SI area of the PDA. 

OG Fig. 6 illustrates the error protocol as blocks of information are sent from the 
J j RDP client to the PDA device. 

^ 20 

!\ Fig. 7 illustrates communication methods between remote devices and host 

!Z computers. 

J Fig. 8 illustrates a wireless communication method between the PDA and the 

□ 25 Host Computer in accordance with another embodiment of the invention. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

To facilitate description, any numeral identifying an element in one figure will 
represent the same element in any other figure. 

5 The principal embodiment of the present invention aims to provide a system that 
allows multiple users operating PDA (Personal Digital Assistant) devices similar 
to a palm top computer to access the Internet or the World Wide Web (WWW), 
as demonstrated in Fig. 4. It is a further aim of the present invention, to provide 
a RDP (Remote Data Protocol) client and sever system to facilitate multiple PDA 
10 users simultaneously on a single server. 

Prior art is disclosed in Fig. 1 where Microsoft Remote Data Protocol is 
f[ demonstrated, using a main RDP server 1 in which virtual machines 2 exist 
Sj capable of running multiple application programs 3. Each virtual machine 2 is 
5^ 15 connected to a dedicated terminal 5 or client on a network system 4, which 
N displays the image of the virtual machine. The terminals 5 on the network allow 
L input of keyboard 6 and mouse 7 commands to the RDP server 1 , with all data 
y processing done on the server and displayed on the terminals. In this method of 
yj prior art, the RDP clients are the terminals on the network. In the present 
g 20 invention however, the RDP clients are represented by software which interact 
between the virtual machines on the RDP server and the PDA devices which 
display the image of the RDP clients, in a completely different fashion. 

A general description of the Prior Art is disclosed in Fig. 2 with further reference 
25 to Patent Applications 09/496,172, 09/501,585, 09/504,809, 09/504,808, and 
09/504,807. A host computer 8 is depicted which is connected to the Internet, 
and that host may also be a Web server. Running in the host computer, is a 
Web server program 9. When a remote user 10 requests to view a Web page (or 
electronic message etc.) the Web server software receives HTML, JAVA, or 
30 other types of information and transmits this information to another software, the 
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Browser Translator 1 1 . This software translates the information, (i.e. the entire 
image comprising graphics and text) received in the form of HTML, Java, etc. (as 
information may be gathered from different sources) and translates it to a black 
and white bit map or raster image. In another embodiment, the software 

5 translates the information into a raster or color image. The image contains the 
information that would normally be displayed on a single Web page. The 
translation program therefore, also acts as a virtual browser. The cellular 
telephone 12 of Fig. 2 is connected to the high speed internet access device 13 
of the invention commonly referred to as a PDA (Personal Digital Assistant) 

10 which is comprised of a display screen 14, battery and related micro-electronics. 
This enables the PDA to receive, decompress and view the bit map image sent 
from the virtual browser, and more importantly, through cellular phone 
connectivity to be able to input data from the PDA directly onto the server 8. In 
particular, the host computer or server of Fig. 2 and Fig. 4 receives vector 

is information or compressed data in the form of HTML, JPEG, etc., which is 
displayed on a web page. The virtual browser virtually displays a virtual image 
on the server by rasterizing the image, or decompressing parts of the image and 
putting it into memory. That image, in whole or parts, is recompressed and sent 
to the PDA. The recompressed data format sent to the PDA, is not necessarily in 

20 the same format as the compressed data format first received by the server. For 
example, the incoming data from a Web page may be in the form of JPEG which 
is decompressed and displayed on the virtual browser. This data is 
recompressed and sent to the PDA but can be in the form of TIFF G4 or other 
formats, and not necessarily JPEG as initially received. 

25 Another embodiment of the invention involves the server receiving vector 

information such as HTML or text and then rasterizing it to bit map format. It can 
then be shown in memory through the virtual browser and is recompressed 
through a "loss less" method and sent to the PDA. 
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The information is received by the device 13 in Fig. 2, which has the ability to 
display a monochrome or color image 15, in its display window 14. The 
information is decompressed and displayed in the order of priority such that part 
of the image 17 of Fig. 3, which substantially or completely covers the 
5 displayable area 14 of the device, is decompressed and displayed first and then 
sequentially the portions 18, 19 and 20 of the image are decompressed, and 
stored in an internal memory of the device to be displayed later when the user 
scrolls up, down, or sideways to these parts of the image. 

10 A principle embodiment of the present invention of Fig. 4 contains the host 
computer 21 which contains an RDP server 22 which is a software unit having 
multiple virtual machines 23 contained within, with each virtual machine 

O 

%Q containing a web browser 24. Multiple RDP clients 25 interact with the virtual 
ff 1 machines with a dedicated virtual machine for each RDP client. Each RDP client 
%j 15 25 is represented by software, which sends the display of each virtual machine 
f~ 23 to a single remote PDA device 26 via a dedicated modem port 27. Each 
N modem port 27 allows a two-way communication between a single PDA 26, 
j-b connected to a cellular phone 64, and a dedicated virtual machine 23 on the RDP 
~ server, via a single dedicated RDP client 25. By implementing multiple virtual 

UJ 20 machines and multiple RDP clients with multiple modem ports, it is now possible 

o 

Q to communicate with multiple users of PDA devices on the RDP server to 

facilitate Internet browsing, electronic message communication, etc. The RDP 
client 25 relays information received from the PDA 26, such as mouse clicks or 
keyboard commands, via a modem port 27 to the Browser 24 in the virtual 

25 machine 23, which is then processed and a refreshed display sent back to the 
PDA via the same dedicated RDP client and modem port. The browser on each 
virtual machine relays display information to the dedicated RDP client such as 
bitmap files, vector files, commands, buffer information, etc. The RDP client then 
rasterizes some of the information by drawing it into memory and then proceeds 

30 to break up this file into smaller blocks of information. These blocks are 
compressed and sent to the PDA device through a dedicated modem port 
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connected to each RDP client, as further illustrated in Fig. 5. The PDA would 
then receive, decompress and assemble the blocks of information in the original 
order as first received by the RDP client before the RDP client breaks up into 
smaller blocks. The browser running in each virtual machine rasterizes most of 
5 the information which is sent to the RDP client such as text, etc., but the RDP 
client may have to rasterize other information such as blocks, etc. 

The PDA 26 of Fig. 4 sends specific data to the virtual machine 23 
informing of the current location of the displayable area 14 of the PDA screen 
10 with respect to the larger image or virtual page 28 sent from the browser to the 
RDP client then to the PDA, as illustrated in Fig. 5. This is necessary, as the 
area displayed 14 by the PDA is smaller than the displayable image on the RDP 
client, referred to as the virtual page 28. The dedicated RDP client would send 
fP compressed blocks of data representing the image to be displayed in order of 
%i 15 priority, such that the first blocks sent to and decompressed by the PDA are in 

H: the displayable area 14 of the PDA, which is the current area where the user is 

y i 

S! viewing. The PDA would then decompress blocks surrounding the displayed 
L area 14 in a particular sequence, such as left to right across rows, and store the 
g image in internal memory. The PDA assembles blocks of the image in a virtual 
uj 20 page 28 stored in the PDA's internal memory, which comprises the entire image, 
S thus enabling the user to access any part of the present image without 

communicating constantly with the RDP client. Hence, as the user scrolls across 
the image in any direction, the blocks of data comprising the image would 
already be decompressed and assembled priority-wise for instant viewing. 
25 Blocks of the image in closer proximity to the displayed area of the PDA screen 
get decompressed and stored into internal memory on higher priority than blocks 
further away. To explain in detail by referring further to Fig. 5, the image 
displayed on the PDA screen 14 can be comprised of blocks 48, 49, 50, 53, 54 & 
55, which are sent from the RDP client first to the PDA, decompressed and then 
30 stored into memory first on the PDA. Then blocks 42, 43, 44, 45, 47, 52, 57, 58, 
59 & 60 would be sent immediately after in that order from the RDP client to the 
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PDA, to be decompressed and stored in the PDA's internal memory. This 
enables a rapid refresh rate of the displayed image especially when scrolling, as 
areas surrounding the displayed image would be decompressed and already 
stored in memory. The PDA continuously sends its current location to the RDP 
5 client to keep getting refreshed data instantaneously, should the location change 
by the user scrolling around or outside the virtual page 28, to enable the RDP 
client to always have the viewing area and surrounding blocks sent to the PDA. 

A mouse click or any keyboard command on the PDA is given priority in 

10 communication between the PDA and the RDP server. Such actions from the 
PDA are sent instantaneously, interrupting the current activities and this action 
directed to the web browser on the dedicated virtual machine, which sends a 
refreshed image back to the PDA device through the RDP client. This feature 
allows the user to have rapid response to commands. If the user initiates a 

is mouse click or keyboard command on the PDA that does not change the 
displayed image on the RDP server, then the original activities are continued 
almost instantly with minimum interruption. However, if the image is changed 
and refreshed on the RDP server, any old image being sent is stopped and the 
new image is sent immediately to the PDA if it is a full screen image occupying 

20 all or part of the PDA display screen. If the refreshed image sent occupies a part 
of the PDA display screen and also areas outside the display screen, then the 
portion of the refreshed image that is displayed on the PDA display screen is 
sent first to the PDA, and blocks of the image surrounding the PDA displayed 
image are sent next to the PDA which are decompressed and stored in internal 

25 memory, as previously described. Hence the PDA would assemble blocks of the 
image in the virtual page, which comprises the entire image, starting first with the 
current location of the PDA display screen then areas around it. 

A beacon is sent from the PDA device to the RDP client and vice-versa 
30 many times per minute to confirm that a connection is established and 

maintained, for the duration of use. In the instance a user is disconnected, either 
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the PDA or the RDP client will not receive a beacon and a time-out will be 
initiated, whereby both the PDA and RDP client disconnect and then reconnect. 
The user would still be able to view the present image and scroll around it as this 
image would already be decompressed in order of priority and stored in internal 
memory. The PDA would indicate in a message area that a reconnect sequence 
was initiated, and the status of this connection to the same RDP client as before, 
which would refresh the PDA with the image if it has changed once reconnection 
is established. Similarly, the PDA would continue downloading blocks of 
information after being reconnected if a disconnection interrupted this operation. 
A beacon is not necessarily sent from the RDP client at times when it is sending 
information to the PDA. As long as the PDA is receiving information such as a 
refreshed image, or a beacon, it knows a connection is established. 
Consequently, when there is no new activity in the virtual machine, the RDP 
client must send a beacon to the PDA to confirm the connection is established. 
The PDA device must always send beacons to the RDP client, as commands are 
not sent frequently from the PDA and only for a short duration when sent. 

An error protocol is implemented to verify that all information blocks are 
received and can be decompressed successfully. As previously described, the 
image displayed in the virtual browser in the virtual machine on the RDP server is 
broken down into smaller blocks of information and compressed and transmitted 
to the PDA device. The blocks are then assembled in correct sequence, 
decompressed and stored in internal memory on the PDA. Each block of 
information received is acknowledged by the PDA, which sends a signal 
confirming that each block is successfully received. Hence, the RDP client can 
monitor the successful decompression of all blocks of information sent to the 
PDA, and would know when a block is not acknowledged. The RDP client would 
also inform the PDA of the number of transmitted blocks of information, with each 
block identified numerically. The PDA also initiates another error protocol when 
a block of information received can not be successfully decompressed and 
stored in memory. In this case, the PDA would send an error message to the 
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RDP client informing which block of information needs to be sent again, and the 
RDP client would send this block after it has completed sending the current block 
of information. The RDP client would monitor the acknowledgement of all blocks 
of information successfully decompressed, including blocks sent again after 
5 receiving error messages from the PDA device. To illustrate this further, 
reference is made to Fig. 6 which shows a string of data blocks 61 to be sent 
from the RDP client to the PDA device. As the PDA receives the data blocks 
acknowledgements or error messages 62 are sent back to the RDP client. Since 
the RDP client responds to all data from the PDA, the string of data blocks 
10 actually sent from the RDP client to the PDA is represented by 63. To further 
explain the events of the RDP client 63, blocks 31, 32, 33 & 34 are sent in this 
order from the RDP client to the PDA, with successful acknowledgements ack31 
y & ack32 sent from the PDA to the RDP client, but whilst block 34 is being sent, 
01 an error message in block 33 is relayed from the PDA, resulting in the RDP client 
-J 15 sending this block 33 again as soon as block 34 is sent. The RDP client 
5j resumes sending blocks 35, 36 and 37, but notices no acknowledgement for 

Li l 

si block 35 after receiving successful acknowledgements ack34 & ack36 sent from 
J\ the PDA, which results in the RDP client sending block 35 after block 37 is sent. 

0 The RDP client may also respond faster or slower to acknowledgements or error 

i i 

y 20 messages as described above. 

The current embodiment as illustrated in Fig. 7 teaches of a standard 
serial connection 66 between the PDA device 13 and a cellular phone 12, with an 
AT command set for communicating between modems. This allows the cellular 
25 phone 12 to act as a modem in communicating with another modem 65 attached 
to the host computer 8. Web pages 67 received from the Internet are converted 
to G4 files 68 then sent via modem to the PDA device. 



For a different type of cellular phone that does not allow AT command set 
30 communication but provides a TCPIP Internet connection, another embodiment 
of the invention is disclosed, as illustrated in Fig. 8. The PDA device would 
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contain a browser to be able to view images sent by the host computer, which 
may be connected to the Internet. In this case, the PDA device 13 would contain 
a mini-browser, which understands and is capable of translating compressed G4 
images. The PDA is connected to a cellular phone 12, which is connected to an 
Internet Service Provider (providing standard Internet services) instead of a 
modem at the Host Computer. The Host Computer is connected to the Internet 
and translates all web pages 67 to G4 compressed files 69. These G4 
compressed files 69 are sent to the PDA in Internet protocol via the Internet 
Service Provider, and the mini-browser in the PDA is capable of translating the 
received images, and displaying on the PDA screen. Hence, the Host Computer 
has Internet images coming in and also Internet images being sent out. The 
Internet Service Provider (ISP) that the PDA connects to would always log on to 
one web page, and when the user at the PDA wants to go to a link or to a 
different web page, the click or the information is sent through the ISP to the host 
computer which will load the new page. This allows multiple users to dial up the 
Internet Service Provider to be able to view web pages from the Internet as 
desired, in this manner. 
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